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Overview 


■  D&SWS  -  An  Air  Force  Core  Process 

■  Technology  Development  (TD)  Core  Sub- 
Process 

■  The  Problem  -  Our  Solution 

■  How  We  Birthed  the  Three  Initiatives 
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AFS021/D&SWS  is  Part  of  the  Answer 


Funding  Our  Priorities 


AF  Smart  Ops  21 


“We  will  fund  transformation 
through  ...  organizational 
efficiencies,  process  efficiencies, 
reduction  of  legacy  systems  and 
manpower  while  sustaining 
GWOT  and  ongoing  operations  in 
support  of  the  Joint  Fight.” 


-  Michael  W.  Wynne,  SECAF 
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The  Status  Quo  is  Out 


AFS021 


■  The  USAF  will  do  less  with  less 

■  Do  what  is  valued  by  our  customers 

■  Employ  tools  and  techniques  smartly  to 
reduce  waste  and  non-value-added 
work,  to  maximize  value  to  the  warriors 


^3  HEM 
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Air  Farce 
Smart  Ops  21 


AF^  S  _Q  21 
Who  How  Where  When 


["[[Creating 


Dynamic 
A  F -wide 
Results 


Enterprise 


Analytic 
Focus  on  CPI 


Process  Efficiencies 

Re  so  trees  for 
Recapitalization 

Measurably  rnproued 
support 
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CSAF  Approved  Process  Owners 


^Develop  and  Sustain 
iWarfighting  Systems  (D&SWS) 
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SECAF  /  CSAF  Approved 
Air  Force  Process  Owners 


Plan/Execute 

■Strategic 

Initiatives 


■Manage 
Programs  and 
Processes 


■Lead 

■Co-Lead 


■Gen  Paul  Hester 

■Lt  Gen  Craig  McKinley 

■PACAF/CC 

■ANG/DIR 

■Lt  Gen  Norman  Seip 

■Mr.  David  Tillotson 

■12AF/CC 

■SAF/XC 

Core 


■Develop 

Warfighters 


■Lead 

■Co-Lead 


■Gen  William  Looney 
■AETC/CC 
■Lt  Gen  Roger  Brady 
■AF/A1 


■Develop  and 
Sustain  Warfighting 
Systems 


■Gen  Bruce  Carlson 
■AFMC/CC 

■Lt  Gen  Donald  Hoffman 
■SAF/AQ 


■Conduct  Air, 
Space,  Cyber 
Ops 


aGen  Duncan  McNabb 
■AMC/CC 

■Mr.  Michael  Aimone 
■AF/A4 


Gen  Kevin  Chilton 
■AFSPC/CC 
■Lt  Gen  Howie 
Chandler 

_ AEIA2I5. _ 


Enabling 


■Caring  for 
People 


■Provide  IT 
Support 


■Provide 

Infrastructure 


■Manage 

Financial 

Resources 


■Lead 

■Co-Lead 


■Lt  Gen  John  Bradley 
■AF/RE  (AFRC/CC) 
Mr.  Roger  Blanchard 
■AF/A1 


■Gen  William  Hobbins 
USAFE/CC 

■Lt  Gen  Michael  Peterson 
SAF/XC 


■Hon.  William  Anderson 
■SAF/IE 

■Lt  Gen  Donald  Wetekam 
AF/A4/7 


■Mr.  John  Vonglis 
■SAF/FM 

■Lt  Gen  Stephen  Lorenz 
■AU/CC 
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D&SWS  Sub-Process  Teams 

(Jun  ’08) 


Process  Owner 

■Co  Lead 


■Gen  Bruce  Carlson 
■Lt  Gen  Don  Hoffman 

■CPO:  MG  Marshall  Sabol 


Institutionalize  Standard 

Oversight  /  Command  & 

Work 

Control 

*ESC/CA  (Ms.  Duntz) 

*AFMC/A2/5  (BG  Wolfenbarger) 

■  Advisors: 

SAF/ACE  Dir  (Mr.  DiCicco) 

AQX  Deputy  (Mr.  Shelton) 

■BG  Smoot  (AFMC/A1) 

AFMC/IG  (Col  Moran) 

SAF/IEL  (Ms.  Walker) 

Technology 

Development 

*AAC/CA  (Ms.  Stokley) 
SAF/AQR  (Mr.  Jaggers) 
AFRL/CC  (MG  Bedke) 

Continuous  Capability 
Planning 

*AFMC/A2/5  (Mr.  Brown) 
HAF/A5R  (BG  Mueller) 

SMC/CV  (BG  Mashiko) 

Lifecycle  Management 

*ESC/CC  (LG  Bowlds) 

ASC/CA  (Ms.  Wright) 
OC-ALC/CC  (MG  Reno) 

Test  and  Evaluation 

*AFFTC/CA  (Mr.  Bond) 
AFOTEC/CC  (MG  Sergeant) 
AFMC/A3  (BG  Lanni) 

Supply  Chain  Operations 

*HAF/A4I  (Mr.  Dunn) 

AFMC/A4  (BG  Bruno) 
AFSPC/A4/7  (Ms.  Puckett) 

Sourcing 

*AFMC/PK  (Mr.  Gill) 

SAF/AQC  (Mr.  Correll) 

*  Indicates  Lead 


TD  Charter 


■  TD  Initiatives  Target  2  Key  Problems: 

■  Immature  Technology  in  Acquisition  Programs  Leads  to 
Cost  Growth  and  Schedule  Slip 

■  Many  Unprioritized  Needs  Lead  to  Sub-optimized 
Investments 


■Approach 


■  Implement  3  TD  Initiatives  to  Institutionalize  One  AF  Level 
Process  to  Manage  Investments  in  Technologies  to  Ensure 
They  are  Mature  for  AF  Systems 

■  Provide  “Standard  Work”  In  the  Technology  Development 
Arena  Where  It  Makes  Sense 


Integrity  -  Service  -  Excellence 


6 


TD  History 

How  We  Birthed. ..and  How  We  are  Implementing 

Our  Initiatives 


■  6  Dec  06  Design  Team  Kickoff  Meeting 

■  Large  &  Diverse  Team 

■  Process-Reengineering  Mandate 

■  Lean  Focus 

■  EVSM,  SIPOC 

■  Diagnosis,  Re-design,  Transfer  of  Ownership 

■  Diagnosis: 

■  TD  is  unwieldy  AF  process  w/many  stakeholders  &  confusion 

■  Lean:  Value-Added  &  Non-Value-Added  Analysis  ® 

■  Root  Cause  Analysis  (5  Whys)  © 

■  Re-Design 

■  Transfer  of  Ownership  to  AF  Functional  Orgs 
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Process-Reengineering  Summary 


•A  Process  for  Process  Redesign 

•Mobilization 

•Diagnosis 

•Redesign 

•Transition 

•Leader 

•Develop 
enterprise 
process  model 

•Appoint  process 
owners  and 
establish 

•Resources 

•Bound  and 
scope  the 
process 

•Understand 

customer 

needs 

•Insight 

•Create  design 
concept 

•Develop  end- 
state  design 

•Develop 

implementation 

roadmap 

•Build  initial 
laboratory 
prototype 

•Test,  learn, 
improve,  and 
iterate 

•Design 

•Implement 
initial  field 
version  (pilot) 

•Realize  initial 
benefits 

•Develop 

supporting 

infrastructure 

m 

governance 

structure 

•Understand 
the  current 
process 

•Identify 
weaknesses  in 
the  existing 
design 

•Set  targets  for 
new  design 

* 

•Determine 

process 

measures 

•Formulate 

process 

strategy 

•Select  design 
team  members 

•Rollout 

•Institutionalize 

•Implement 

succeeding 

releases 

•Get  organized 

•Get  oriented 

•Get  crazy 

•Get  real 

•Nov  06  «Jan  07 

•Mar  07 

•Jul  07 

End-to-end  Assessment  Complete: 

■  Significant  value-stream  analyses  and  process 
mapping  conducted 

■  Identified  27  issues  /  opportunities 

■  Created  “To-Be”  state  for  process  redesign 

■  Multiple  process  improvement  initiatives 
aligned  under  4  Focus  Areas 

■  Measure  success  against  3  customer-oriented 
objectives 
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Tech  Development 

As-ls  Process:  Issues  &  Opportunities 
Briefed  to  D&SWS  Process  Council  Spring  07 


■  As-is  Process  is  not  well  understood;  involves  many  stakeholders;  is  not  conducive  to 
strong  and  consistent  collaboration 

■  16  Issues/Opportunities  Identified  and  Prioritized 

■  Four  principal  areas  to  focus: 

■  Identifying  and  prioritizing  technology  investment  needs  and  communicating  what  we  are  doing 

■  More  comprehensive  and  effective  technology  maturity  assessment 

■  Earlier  and  more  responsive  Technology  Transition  Planning 

■  Establishing  AFRL  as  the  AF’s  Trusted  Advisor  and  Honest  Broker 
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Tech  Development 
As-ls  Process:  Many  Issues 
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“Lean”  Was  of  Limited  Value  in  Identifying 

the  Problems 


■  1* 

Available 

Resources 
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Root  Cause  Analysis  Helped  Us 
Zero-In  on  the  Real  Issues 


Why  Is  Immature 
Technology  getting 
Into  our  systems? 


1.1  Limited 
definition  of 
maturity 


1.1.1  Does  not  well  include 
the  “ilities” 

•  Testability 

•  Supportability 

•  Maintainability 

•  Producibility 

•  Manufacturability 

•  Scalability 
environment  for  integration 


1.1.2  System  Tech 
TRL  (multiple  tech) 
vs.  lower  level  TRL 
(single  technology) 


1.1. 1.1  Have  not 
defined  or 
described  how  to 
include  other 
criteria  into  more 
comprehensive 
TML 

I 


A 


1.1. 1.2  Info  to 
define  criteria  is 
not  available 


1.1. 1.2.1 
Insufficient 
communication 
between  S&T 
Providers/  System 
Developers/ 
Sustainers 


c 


1.1. 1.3  Early  Tech 
Development 
shouldn’t  focus  on 
system  aspects 


1.1. 1.3.1  AF  needs 
freedom  -  Mature 
tech  outside 
system  constraints 


1.1. 1.3.1. 1  Tech 
definition  should 
allow  assessment 
at  Tech  &  System 
Level 


1.1. 1.2.1 
Education  issue 

I 


B 


1. 1.2.1  TRL 
criteria  not  applied 
to  system 


1.1. 1.2.2  Don’t 
know  how  to  roll 
up  single 
technology  to 
multiple 
technology 


A 


A 
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Tech  Development  “To-Be”  Process 
Opportunities  for  Improvement 


TD-1-14 

•  Comprehensive  ID  &  prioritization  of 
tech  needs 

•  Solves  the  problem  of 
understanding/interpreting  AF’s 
Capability  Needs  and  Program  Rqmnts 

•  Game-changing  “tech  push”  influencing 
capability  planning  (and  vice  versa) 

AF-Wide  Requirements  Database 


Tools 


TD-1-12 


Tech  Maturity  Assessment 
“Calculator” 


More  frequent  maturity  assessments 
More  robust  maturity  assessments 
•  Common  process/tool  for  Gov’t  &  Industry 


TD-1-13 


Transition  Planning  & 
Stage-Gating  Tool 


•  Earlier  transition  planning 

•  Combined  with  tech  maturation  planning 

•  Gated  reviews  to  ensure  timely  and  robust  tech 
development 

•  Also  enables  tech  off-ramps  to  support  Acq 
’’Time  Certain  Capability” 
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Three  TD  Initiatives 


3  Initiatives  with  the  goal  of  institutionalizing  one  AF  level  process  to  manage 
^^mvestment^nJechnolocjie^tojmsureJhe^jirejTiatur^ 


■TD-1-12  Improved  Technology  Maturity  Assessment 
•  Improved,  but  Separate,  Qualitative  Maturity 
Assessments 

•  TRA  Training 

•  MRA  Training 


•Improved  Software  TRL  descriptions 
•  A  methodology  to  help  identify  Technical  Risks 
related  to  Integration  &  ‘ilities 


iTD-1-13  High  Confidence  Tech  Transitions 
Early  &  complete  lifecycle  transition  planning 

•  Formal  documentation  of  IPT’s  plan  -  TDTS 

•  “Plan  the  Flight” 

“Stage-gated”  transition  of  technology 

Clearly  defined  entrance/exit  Criteria 

•  “Fly  the  Plan” 


■  TD-1-14  Identify  and  Prioritize  Tech  Needs 

•  Focus  S&T  on  highest  priority  needs 

•  Integrate/align  existing  processes  to  identify  tech  needs 

•  Develop  new  process  to  prioritize  short,  mid,  and  far-term 
needs  vice  a  single  “1-n”  list 

•  Game-changing  “Tech  Push”  influencing  capability  planning 


■  14 
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Two  Benefits  to  Solving  the 
“Immature  Technology”  Problem 


The  ability  to  more  accurately  assess  the  maturity  of  technology,  across  dimensions 
more  meaningful  to  acquisition  &  sustainment  programs  promises  2  benefits: 

1.  Pre-MS-B:  More  accurate  assessment  of  tech  maturity  guides  more  complete  tech 
development  and  enables  more  accurate  program  estimates  (RDT&E  and  Production) 

Result:  Reduction  in  Cost  Overruns  (cost  avoidance) 

-  $1B-$3.5B  per  year  with  an  ROI  of  2.6-4.2  (GAO  report) 

2.  Post-MS-B:  Targeted  tech  assessments  within  on-going  programs  may  offer  timely  (and  previously 
unknown)  tech  alternatives 

Result:  Reductions  in  projected  [budgeted]  costs  (cost  avoidance) 

-  Specific  examples  available  (F-22  AESA  with  ROI  of  76:1,  etc.) 
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Pay  Me  Now  ($)  or  Pay  Me  Later  ($$) 


■  It  costs  money  to  save  money 

■  It  also  costs  money  today  to  avoid  future  cost 
overruns 

■  TD  (and  other  D&SWS  initiatives)  are  proposing 
initiatives  that  will  drive  additional  costs  earlier  in  the 
development  cycle 

■  For  TD-1-12  &  13,  this  means  additional  RDT&E  funding  to 
mature  technologies  more  robustly... earlier... so  they  are 
MATURE  when  they  get  into  acquisition  programs 


■  16 
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Want  to  Change  Behavior? 

Train  the  Workforce! 

■  All  three  TD  initiatives  propose  new  processes/tools  that  will  require 
workforce  training 

■  Both  DAU  and  AFIT  have  a  critical  roles 

■  TD  initiatives  will  develop  required  workforce  training: 

■  Advanced  training  for  personnel  working,  or  about  to  work,  the  new 
processes/tools  (TD-1-12  Only  for  TRAs  and  MRAs) 

■  General  Awareness  training  appropriately  tailored  to  fit  into  the  many 
existing  DAU  and  AFIT  S&T/  Acquisition/  Sustainment  “Familiarization” 
courses 


Advanced 

Training 

General  Awareness 
Training 

Computer-Based 

AFIT 

DAU  &  AFIT 

Classroom 

AFIT 

DAU  &  AFIT 
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Are  We  Sure  Our  Process- 
Improvement  Initiatives  Will  Achieve 

Desired  Affect? 


■  TD-1-12  and  TD-1-13  will  participate  in  D&SWS  pathfinders 
■  Five  Pre-MS  B  AF  Acquisition  Programs  Designated  as  Pathfinders 


Seven  D&SWS  Initiatives  to  be  “Tested” 

■  LCM-1 -7:  Time  Certain  Capability 

■  LCM-1 -8:  High  Conf  Baselines 

■  LCM-1 -9:  Life  Cycle  Affordability  Planning 

■  CCP-1-10:  Time-Phased  Requirements  Development 

■  TD-1-12:  Improved  Technology  Maturity  Assessments 

■  TD-1-13:  High  Confidence  Technology  Transitions 

■  TE-1 -1 6:  T&E  Milestone  B  Support 


■  New  TD  processes  will  be  integrated  into  an  existing  schedule 
as  expediently  and  cost-effectively  as  possible 

■  However... D&SWS  pathfinders  will  provide  limited  verification  and 
validation  of  TD  initiatives 

■  Will  not  sufficiently  exercise  TD’s  process  improvements 

■  Additional  pilots  will  be  required  (Some  of  AFRL’s  6.3  portfolio) 


■  18 
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Summary 


■  We  diagnosed  the  problem 

■  Why/How  is  Immature  Technology  Getting  into 
Weapon  Systems? 

■  We  proposed  solutions  -  Process-Improvement 
Initiatives  Designed  to: 

■  More  robustly  Assess  Technology  Maturity  (TD-1-12) 

■  Plan  Transition  Earlier  &  Be  More  Disciplined  in 
Implementing  Those  Plans  (TD-1-13) 

■  “Plan  the  Flight.. .Fly  the  Plan! 

■  Tools,  Training,  Policy  Will  Facilitate  Implementation 

■  Getting  Ready  to  “Test  our  Products” 
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